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a . . . ^ 

^ ^ s. * (57) Abstract: 

PROBLEM TO BE SOLVED: To provide a surround sound field reproduction 
system that can localize a sound image in matching with a direction in 
which a viewing/listening person views a video image in front when the 
viewing/listening person sets the direction of the video image to view 
it in front of the person. 

SOLUTION: The surround sound field reproduction system is provided with 
horizontal panning pots HP1-HP6 that receive audio signals from 
microphones H1-H6 placed in a horizontal direction and control 
horizontal direction localization in interlocking with each other and a 

vertical panning pot VP that receives audio signals from microphones T, 
B installed in a vertical direction and controls localization in the 
vertical direction. The horizontal panning pots HP1-HP6 distribute 
levels to mixing buses L, Cm, R, Ls, Rs arranged corresponding to 
surround reproduction output channels L, C, R, Ls, Rs and the vertical 
panning pot VP changes a level distribution of the audio signal in the 



vertical direction to provide an output of the result to an output 
channel for a front center. 
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CLAIMS 
[Claim(s)] 

[Claim 1] It is the surround sound field regeneration system to which 
the front normal position is carried out [ voice / to which a viewer 
points to the voice by which omnidirection sound-collecting was carried 
out ]. Two or more level pan pot means to control the horizontal normal 
position by inputting the sound signal of two or more input channels 
which collected the sound source of 360 degrees horizontally, 
respectively, interlocking mutually and distributing the voice level of 



each channel to two or more output channels, A perpendicular pan pot 
means to control the perpendicular direction normal position with 
outputting the sound signal which inputted the sound signal of two or 
more input channels which collected the sound source of 180 degrees 
perpendicularly, respectively, and changed level allocation of each 
input channel to the output channel for front pin center, larges, 
******** surround sound field regeneration system. 
[Claim 2] The surround sound field regeneration system according to 
claim 1 characterized by constituting so that it may have the mixing bus 
of the number on the basis of an output channel required for playback 
sound field and level allocation of the output of each of said level pan 
pot means may be carried out into said all mixing buses. 
[Claim 3] Said mixing bus is a surround sound field regeneration system 
according to claim 2 characterized by having five buses, the front left 
mixed as an object for the horizontal normal position, a front pin 
center, large, the front right, the back left, and the back right. 
[Claim 4] Six into which said input channel inputs the sound signal of 
six directions collected from the six directions of the horizontal front 
left, the front right, the left, the right, the back left, and the back 
right It has two channels [ a total of eight ] which inputs the sound 
signal of the vertical upper part and a lower part. Said output channel 
The front left, the front right, the back left, and said four mixing 
buses of the back right. The surround sound field regeneration system 
according to claim 3 characterized by having five output channels 
connected to the output of said perpendicular pan pot means which 
considers said input channel of said mixing bus for the front normal 
position of said front pin center, large, the vertical upper part, and a 
lower part as an input. 

[Claim 5] The surround sound field regeneration system according to 
claim 4 characterized by outputting the low-pass component contained in 
said all output channels, and having the 6th output channel applied to 
the 5. 1 Channel surround-sound system. 

[Claim 6] The surround sound field regeneration system according to 
claim 1 characterized by having a bearing input means to direct panning 
actuation in the direction which a viewer wants to hear to said level 
pan pot means and a perpendicular pan pot means so that a front pin 
center, large may be made to orientate. 



[Translation done. ] 
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DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] Especially this invention relates to the 
surround sound field regeneration system to which it was made to carry 
out [ voice / to which inputs the voice collected from the omnidirection 
about a surround sound field regeneration system, and a viewer points ] 
the front normal position. 
[0002] 

[Description of the Prior Art] Conventionally, in the movie theater, 
multichannel surround is taken in and the surround voice which is full 
of presence with the image projected on a large-sized screen was able to 
be reproduced. Such surround sound field playback currently performed in 
the movie theater is being introduced also into home use. 
[0003] In order to reproduce surround sound field space, the source and 
the system which reproduces it are required. The source has the 
videodisk by DVD (Digital Versatile Disk), DVD-ROM (Digital Versatile 
Disk Read Only Memory), etc., a cable system, satellite broadcasting 
service, digital television broadcasting, etc. , and the Internet 
broadcast is also considered. The 5. 1 Channel surround-sound system of a 
regeneration system is common. This 5. 1 Channel surround-sound system 
consists of the equipment and the loudspeakers of a maximum of six 
channels which reproduce the source. A loudspeaker consists of the 
loudspeaker arranged in front right and left and the front pin 
center, large, a loudspeaker arranged at back right and left, and a 
loudspeaker for subwoofers which takes out a heavy bass enhancement 
effect. 

[0004] A viewer will listen to surround voice, usually looking at the 
video monitor installed near the loudspeaker for front pin center, larges 
in the center surrounded by those loudspeakers. This is because an image 



and voice viewed and listened in such a location, and the maker meant 

and made so that most effectively. 

[0005] 

[Problem(s) to be Solved by the Invention] however, the sound field 
which the maker meant the conventional surround playback and were made 
from it being the forced thing which it makes reproduce as it is For 
example, although a viewer will change the posture which looks at an 
image according to the direction of a sound source when seeing in front 
what emits the sound which has the image of an omnidirection and is in 
the image Since the image had been orientated in the front pin 
center, large, it could not take matching with an image and voice, but 
had the trouble that sense of incongruity occurred in image appreciation. 
[0006] This invention is made in view of such a point, and when the 
image which a viewer wants to observe is made visible to a transverse 
plane, it aims at offering the surround sound field regeneration system 
which can make an image orientate in the direction it was made visible 
[ direction ] to a transverse plane according to it. 
[0007] 

[Means for Solving the Problem] According to this invention, it is the 
surround sound field regeneration system to which the front normal 
position is carried out [ voice / to which a viewer points to the voice 
by which omnidirection sound-collecting was carried out ]. Two or more 
level pan pot means to control the horizontal normal position by 
inputting the sound signal of two or more input channels which collected 
the sound source of 360 degrees horizontally, respectively, interlocking 
mutually and distributing the voice level of each channel to two or more 
output channels, A perpendicular pan pot means to control the 
perpendicular direction normal position with outputting the sound signal 
which inputted the sound signal of two or more input channels which 
collected the sound source of 180 degrees perpendicularly, respectively, 
and changed level allocation of each input channel to the output channel 
for front pin center, larges, A ******** surround sound field 
regeneration system is offered. 

[0008] According to the above-mentioned configuration, each level pan 
pot means distributes horizontal voice to two or more output channels 
among the voice by which omnidirection sound-collecting was carried out, 
respectively. By a perpendicular pan pot means changing each level 
allocation, and having made it output vertical voice to the output 
channel for front pin center, larges It can choose in the direction from 
which a viewer wants to hear the voice by which omnidirection sound- 
collecting was carried out continuously or momentarily, and the voice to 



which it pointed can be orientated in the front pin center, large, and 
the voice of the perimeter by which it was accompanied can be reproduced 
now in surround sound field, 
[0009] 

[Embodiment of the Invention] Hereafter, the case where the gestalt of 
operation of this invention is applied to 5. 1 surround-sound systems is 
explained to an example with reference to a drawing. In addition, about 
the subwoofer output in 5. 1 surround-sound systems, it is the channel 
which reproduces the low-pass component of all channels, and since it 
did not point to the low-pass component and it does not contribute to 
the image normal position, it is made to explain if needed here. 
[0010] First, the voice and its sound-collecting principle of 
omnidirection sound-collecting inputted into the surround sound field 
regeneration system by this invention are explained. Drawing 1 is 
drawing explaining an omnidirection voice sound-collecting principle. 
[0011] Omnidirection sound-collecting is collected by two or more 
microphones arranged in all the celestial sphere. In the example of 
illustration, horizontally, six microphones H1-H6 keep spacing (60 
degrees) equal to a hoop direction, and are arranged towards the method 
of the outside of radial, respectively, and one microphone T and B is 
arranged [ in each perpendicular direction ] towards a top and down, 
respectively up and down. All the sound sources that exist in all the 
celestial sphere are collected by these eight microphones H1-H6, and T 
and B. 

[0012] In addition, as these sound sources, the sound source of 
inclusion studio, the sound source in the actual live hall, the sound 
source of synthesized speech, or the virtual source is included. Next, 
the surround sound field regeneration system of this invention which 
considers such eight sound sources as an input is explained. In addition, 
the same sign shall also express the above-mentioned microphones H1-H6 
and the sound signal acquired by T and B in the following explanation. 
[0013] Drawing 2 is drawing having shown the principle configuration of 
the surround sound field regeneration system of this invention. The 
surround sound field regeneration system by this invention inputted the 
output sound signal of six horizontal microphones H1-H6, respectively, 
and is equipped with six level pan pots HP1-HP6 which control the 
horizontal normal position. These level pan pots HP1-HP6 interlock 
mutually, and it operates, and those outputs are connected to five 
mixing buses L, Cm, R, Rs, and Ls so that level allocation may be 
carried out, respectively. 

[0014] These mixing buses L, Cm, R, Rs, and Ls are formed corresponding 



to the surround playback output channels L, C, R, Ls, and Rs (a mixing 
bus, a corresponding surround playback output channel, and a 
corresponding sound signal may use the same sign hereafter). That is, 
the output channel Rs and the mixing bus Ls for back right support [ the 
mixing bus L / output channel / for front left / L and the mixing bus Cm 
/ output channel C for front pin center, larges, and the mixing bus R / 
output channel / for front right / R and the mixing bus Rs ] the output 
channel Ls for back left. In addition, since there is no microphone 
which has turned to the front pin center, large by this example, in view 
of the number of microphones, by mixing bus Cm, the sound signal Cm as a 
horizontal object for front pin center, larges is mixed. 
[0015] Moreover, the output sound signal of the microphone T for upper 
part sound-collecting of the sound source for perpendicular and the 
microphone B for lower part sound-collecting and the signal of the 
mixing bus Cm were inputted among omnidirection sound-collecting, and it 
has the perpendicular pan pot VP which controls the perpendicular 
direction normal position. The output of this perpendicular pan pot VP 
constitutes output channel C for front pin center, larges. 
[0016] The location of the perpendicular direction of arbitration can be 
made to orientate the voice of the perpendicular direction of the 
location by which the front normal position was carried out in the above 
configuration by being able to carry out [ voice / in which a viewer 
points to the level pan pots HP1-HP6 to the voice by which omnidirection 
sound-collecting was carried out by carrying out interlocking actuation 
/ horizontal ] the front normal position, and operating the 
perpendicular pan pot VP perpendicularly to coincidence. 
[0017] Next, horizontal panning is explained. Drawing 3 is the 
explanatory view showing the relation between panning of a horizontal 
sound source, and playback sound field. The relation between the they- 
inputted sound signals H1-H6 and the sound signals L, Cm, R, Rs, and Ls 
made on a bus is shown and explained on a periphery about panning which 
carries out level allocation of the sound signals H1-H6 inputted from 
the horizontal microphones H1-H6 into the mixing buses L, Cm, R, Rs, and 
Ls. 

[0018] Since microphones H1-H6 are turned in the direction which divided 
the perimeter equally in the horizontal sound, sound signals H1-H6 are 
arranged in at equal intervals on the periphery of the illustrated 
circle. 

[0019] On the other hand, the sound signal L of the mixing bus L has 
taken the relative include angle so that the sound signal Ls of the 
method of the right rear and the mixing bus Ls may become [ the sound 



signal Cm of the left of drawing, and the mixing bus Cm / the sound 
signal R of a front pin center, large and the mixing bus R ] the method 
of the left rear of drawing in the sound signal Rs of the right of 
drawing, and the mixing bus Rs, noting that sound field required for 
surround voice playback are the directions of a transverse plane of a 
system about the upper part of drawing 3 . Of course, whenever [ such 
angular relation ] does not decide to become the the best for the 
regeneration system determined by arrangement of a loudspeaker etc. , and 
it is not limited to the example of illustration. 

[0020] Drawing 4 is the explanatory view showing the damping property of 
horizontal panning. The horizontal sound signals H1-H6 have the property 
decreased as it is 1, and attenuation does not have Gain A and it 
separates from an orientation center line to a longitudinal direction on 
the orientation center line of the direction which microphones H1-H6 
have turned to. For this reason, as for the channel whose location and 
surround playback output channels L, C, R, Rs, and Ls of the inputted 
sound signal Hx (x=l-6) correspond, level allocation serves as IxHx. 
Moreover, when there is a certain output channel in the middle of H1-H2, 
two inputs are compounded by the level allocation which doubled each 
sound signal HI and H2 0. 708 so that audibility energy might become 
fixed. 

[0021] Therefore, in the initial state of horizontal panning shown in 
drawing 3 , the scale factor by which level allocation is carried out 
becomes as follows into each mixing buses L, Cm, R, Rs, and Ls. 

[0022] 

[Equation 1] L: IxHl ... (1) 
[0023] 

[Equation 2] 

Cm: 0.708 (H2+H3) ... (2) 
[0024] 

[Equation 3] R: lxH4 ... (3) 

[0025] 

[Equation 4] Rs: lxH5 ... (4) 
[0026] 

[Equation 5] Ls: lxH6 ... (5) 

Here, the example of the horizontal level allocation when carrying out 
panning is shown. 

[0027] Drawing 5 is the explanatory view showing the relation between 

the horizontal sound source at the time of panning, and playback sound 
field. Suppose that voice to operate the level pan pots HP1-HP6, and use 
as a front pin center, large was moved rightward 30 degrees. Level 



allocation into the mixing buses L, Cm, R, Rs, and Ls of the sound 
signals H1-H6 at this time can be obtained from the damping property 
explained by drawing 4 as follows. 

[0028] 

[Equation 6] L:0. 708 (H1+H2) ... (6) 
[0029] 

[Equation 7] Cm: lxH3 ... (7) 
[0030] 

[Equations] R:0. 708 (H4+H5) ... (8) 
[0031] 

[Equation 9] 

Rs: 0.708 (H5+H6) ... (9) 
[0032] 

[Equation 10] 

Ls: 0.708 (H6+H1) ... (10) 

Next, vertical panning is explained. 

[0033] The explanatory view in which drawing 6 shows the damping 
property of vertical panning, the explanatory view in which drawing 7 
shows the relation between panning of a perpendicular direction sound 
source and playback sound field, and drawing 8 are the explanatory views 
showing the relation between the perpendicular direction sound source at 
the time of panning, and playback sound field. 

[0034] the sound signal Cm used as the vertical sound signals T and B 

and the horizontal front is alike, respectively, and when the output of 
surround playback output channel C used as a front pin center, large is 
in agreement, sound signals T, Cm, or B do not have attenuation, and are 
outputted as they are. When there is an output of surround playback 
output channel C in the middle of T-Cm, or the middle of Cm-B, it will 
be compounded and outputted so that the sum of the audibility energy of 
two signals may always be set to 1. 

[0035] For example, the MIKISHI level supplied to surround playback 

output channel C from two each when panning is carried out in one 
between T-Cm or Cm-B of the centers is [0036]. 

[Equation 11] 

C: — 0.708 (T+Cm) or 0.708 (Cm+B) ... (11) 
It becomes. 

[0037] Here, as shown in drawing 7 , the adjustable range of 
perpendicularly panning can be carried out is 180 front faces. According 
to the damping property explained by drawing 6 , like illustration, 
level allocation with the sound signal Cm mixed as as horizontal when 
the perpendicular pan pot VP is made into a center valve position the 



front normal position as the vertical sound signals T and B is [0038]. 
[Equation 12] C: IxCm ... It is set to (12). 

[0039] It is [0040] from a damping property which explained the level 
allocation to surround playback output channel C of a front pin 
center, large by drawing 6 when vertical panning was moved upwards 45 
degrees from the horizontal position of drawing 7 , as shown in drawing 
8 . 

[Equation 13] 

C: 0,708 (Cm+B) ... (13) 

It becomes. 

[0041] Next, the example from sound-collecting to playback of realizing 
the surround sound field regeneration system of this invention is 
explained. First, omnidirection voice sound-collecting is explained. 
Thereby, omnidirection voice sound-collecting can obtain the good degree 
of separation between channels using a unidirectional microphone, 
although presence and directional characteristics are acquired. If 
horizontal, the more it makes [ many ] the number of channels which 
collects a sound, the more it is necessary to make the microphone to be 
used into a thing with acute angle directional characteristics. 
[0042] The sound signal of omnidirection sound-collecting can be 
recorded, or can be distributed directly. This sound signal recorded at 
the time [ a sound signal ] or distributed can be made into a form as it 
is or the compressed form. 

[0043] Although an image recorder, digital VTR (Video Tape Recorder), 
etc. will be used when recording the sound signal of omnidirection 
sound-collecting with an image, since only two channels or four channels 
have a voice truck, these will distribute a required voice channel to 
two or more image recorders and digital VTR, and will carry out 
coincidence record. In order to take the synchronization between 
channels at this time, it records on two or more image recorders and 
digital VTR with the same time code, for example, a SMPTE (Society of 
Motion Picture and Television Engineers) time code, respectively. 
[0044] Moreover, all the voice of an omnidirection may be recorded as 
they are by the multi-track recorder as the another record approach. In 
that case, when [ all ] there is an image, it will record with the same 
time code. 

[0045] As the still more nearly another record approach, the number of 
voice of an omnidirection is compressed into two channels, and it may be 
made to carry out digitized voice record. The archive medium in this 
case is desirable, and digital VTR, and DAT (Digital Audio Tape) and HDD 
(Hard Disc Drive) are used. 



[0046] Subsequent explanation explains a system until omnidirection 
sound-collecting can be compressed, it can record, it can restore the 
recorded sound signal and it can apply to the surround sound field 
regeneration system by this invention. 

[0047] Drawing 9 is the block diagram showing the example of the record 
structure of a system by omnidirection sound-collecting. Although it is 
in making it record by more channels in order to make the voice which 
exists in an omnidirection reproduce faithfully as much as possible, 
adaptation to the 5. 1 Channel surround from the supplied sound source of 
eight channels which considered as omnidirection sound-collecting by 
total of eight channels here, and were suitable for it from the 
effectiveness on the whole structure of a system shall be aimed at. 
[0048] The omnidirection sound-collecting record system has the head 
amplifiers 11, 12, 13, 14, and 15 which input into the input section the 
sound signal which collected the sound with vertical Microphones T and B 
and horizontal microphones H1-H6. These head amplifiers 11, 12, 13, 14, 
and 15 are equipped with the AGC (Automatic Gain Control) function to 
perform rationalization of the compression of a dynamic range, and level 
while they amplify the inputted sound signal with a predetermined 
amplification factor. When an AGC function can be made into 
effective/invalid if needed and it confirms, audio gain and the 
controlled variable of AGC are made at least for all directions to have 
interlocked mutually between the head amplifiers 11, 12, 13, and 14 of 
all channels, and 15. 

[0049] The output of head amplifiers 11, 12, 13, 14, and 15 is connected 
to the input of every the two-channel three analog-to-digital converters 
16, 17, and 18. Analog-to-digital converters 16, 17, and 18 change the 
analog sound signal of two channels into a 16-24-bit serial digital 
signal, respectively. 

[0050] The output of analog-to-digital converters 16, 17, and 18 is 
inputted into the compression encoder 19 which performs compression 
processing to two channels in the signal of eight channels by which 
digital conversion was carried out. As this compression encoder 19 of 
eight channels, the ^''Dolby E'' multichannel coding technique which U. S. 
DORUBI developed is used. In addition, the audio compression technology 
ATRAC (Adaptive TRansform Acoustic Coding)'' which Sony Corp. developed 
can also be used as another speech compression equipment. 
[0051] The output of the compression encoder 19 is connected to digital 
VTR 20 through AES / EBU (Audio Engineering Society/European 
Broadcasting Union) twisted-pair cable which is a business-use digital 
audio interface. 



[0052] In the omnidirection sound-collecting record system of the above 
configuration, the sound signal collected by microphones T, B, H1-H6 is 
amplified with head amplifiers 11, 12, 13, 14, and 15, respectively, and 
performs level equalization using an AGC function if needed. 
[0053] Next, the inclusion voice of eight channels is compressed into 
two channels with the compression encoder 19, and the serial digital 
signal of two channels is recorded on two audio tracks of digital VTR 20. 
[0054] Drawing 10 is the block diagram showing the example of a system 
configuration of an omnidirection surround regenerative apparatus. The 
function of this omnidirection surround regenerative apparatus is 
mounted on the audio decoder board 30 built into a personal computer in 
this example. The audio decoder board 30 has the decoder 31 which inputs 
the signal received on the signal or real time recorded on the digital 
VTR 20 shown in drawing 9 . This decoder 31 has the function which 
decodes the inputted two-channel serial digital signal of a compression 
format to four two-channel serial digital audio signals using the 
decryption technique of a ^^Dolby E'' compression format. The output of a 
decoder 31 is connected to the input of DSP (Digital Signal Processor) 32. 
DSP32 has the function which processes four two-channel serial digital 
audio signals, and outputs six surround playback output channels L, C, R, 
Ls, Rs, and SW. Here, the surround playback output channel SW is an 
output channel for subwoofers which takes charge of playback of the low- 
pass component of all channels. Therefore, these six surround playback 
output channels L, C, R, Ls, Rs, and SW are direct connectable with the 
external 5. 1 Channel surround-sound system. 

[0055] The pan / level control table 33 is connected to DSP32. This pan 
/ level control table 33 pass the pan location data level and for the 
panning control corresponding to it from the seat table directed with 
the bearing input device which stores the mixing distribution data of 
each channel corresponding to a vertical panning control input, and is 
mentioned later performed according to directions of a viewer to DSP32. 
Especially the resolving power of an omnidirection does not need to be 
high and 8 bits - about 10 bits and a perpendicular direction enable it 
to control panning by 180 upper and lower sides with the resolving power 
of about 8 bits by the horizontal perimeter. 

[0056] The audio data / PCI bridge 34 for control from which DSP32 
changes transfer of a signal between the PCI (Peripheral Component 
Interconnect) buses which are the expansion slots of a personal computer 
again are connected. 

[0057] In the omnidirection surround regeneration system of the above 
configuration, decoding to a two channel x4 serial digital audio signal 



is performed in the sound signal of the channels T, B, H1-H6 which 
decoding of a compression format was performed by the decoder 31, and 
the serial digital signal compressed into two channels collected. 
[0058] Four decoded serial digital audio signals mix each bearing signal 
by DSP32 next to the surround playback output channels L, C, R, Ls, Rs, 
and SW. If panning directions are then inputted through audio data / PCI 
bridge 34 for control from a bearing input device, the mixing control 
signal corresponding to the directions will be given to DSP32 from a pan 
/ level control table 33, and DSP32 will perform mixing processing 
according to the directions. 

[0059] Drawing 11 is drawing showing the example of a screen display of 
a bearing input unit. The bearing input device 40 is for outputting 
panning directions to the audio decoder board 30 of an omnidirection 
surround regenerative apparatus, and a screen display is carried out on 
the monitor of a personal computer. Here, it is the screen of the 
bearing input device 40 from the sub screen 41 which performs a 
horizontal setup, and the sub screen 42 which performs a vertical setup. 
[0060] A bird' s-eye view which looked at the playback location of the 
horizontal surround playback output channels L, C, R, Ls, and Rs from 
back slant expresses omnidirection surround sound field to the sub 
screen 41 for a horizontal setup. The arrow head 43 showing the 
direction of the voice the front normal position is carried out 
[ voice ] is arranged at the core at which a viewer is located. 
[0061] The direction of an arrow head 43 can be rotated 360 degrees by 
dragging the tip of an arrow head 43 to a longitudinal direction in the 
condition of having pointed with the mouse pointer and the horizontal 
seat expression news inputted there is sent to the audio decoder board 
30 to change the direction of the front normal position. 
[0062] The sub screen 42 for a perpendicular direction setup has the 
arrow head 44 showing the range of the vertical direction which can be 
set up, and the mark 45 which expresses the normal position of the 
vertical direction on the line is arranged. The normal position of the 
vertical direction can be inputted by dragging this mark 45 in the 
vertical direction with a mouse pointer to change the normal position of 
the vertical direction. This inputted seat expression news is also sent 
to the audio decoder board 30 together with level input. 
[0063] Next, the level pan pot actuation and perpendicular pan pot 
actuation which are performed within DSP32 of the audio decoder board 30 
are explained. In addition, in order to give explanation intelligible, 
mixing to level and the mixing bus to a vertical input is replaced and 
explained to analog type volume here. 



[0064] Drawing 12 is an explanatory view in which water square shows the 
relation between an input and a mixing bus. A level pan pot has the 
resistor 50 formed in the shape of a ring, and the mixing buses L, Cm, R, 
Rs, and Ls are connected to the horizontal location corresponding to the 
periphery top of the resistor 50, respectively. Moreover, the rotator 51 
which is interlocked with the level directions input of the bearing 
input unit 40, and is rotated is formed on a resistor 50 and this 
alignment, in the periphery, the movable pieces 52-57 which carry out 
contact sliding with a resistor 50 are formed corresponding to the sense 
of the microphones H1-H6 arranged horizontally, and the sound signal 
acquired from microphones H1-H6, respectively is inputted into these 
movable pieces 52-57 at it. 

[0065] The condition of illustration of this level pan pot shows the 
condition that the image normal position is carried out to the 
transverse plane. Here, by turning a rotator 51 in the direction to 
which the viewer pointed, namely, rotating the arrow head 43 shown in 

drawing 11 to a longitudinal direction with a mouse pointer, the 
inputted sound signals H1-H6 will interlock mutually, and level 
allocation will be carried out into each mixing bus L, Cm, R, Ls, and Rs 
of each at coincidence. 

[0066] Drawing 13 is the explanatory view showing the relation between a 
perpendicular bearing input and a mixing bus. A perpendicular pan pot 
has the resistor 60 formed on the straight line, the terminal which 
inputs the sound signal from the microphones T and B horizontally 

arranged to the both ends of the resistor 60 is connected, and the 
mixing bus Cm is connected to the mid gear. Moreover, the movable piece 
61 which is interlocked with the perpendicular directions input of the 
bearing input unit 40, and carries out contact sliding with a resistor 

60 linearly is formed. This movable piece 61 is connected to output 
channel C for front pin center, larges. 

[0067] The condition of illustration of this perpendicular pan pot shows 
the condition that the image normal position is carried out to the 
transverse-plane horizontal position. Here, by moving the movable piece 

61 up and down to perpendicularly the viewer directed, namely, moving 
the mark 45 shown in drawing 11 in the vertical direction with a mouse 
pointer, level allocation will be carried out and the inputted sound 
signals T, B, and Cm will be outputted to output channel C for front pin 
center, larges. 

[0068] Although the case where horizontal sound-collecting was used as 
six channels was shown in the example, the above explanation is 
realizable by increasing the horizontal number of sound sources, in 



order to carry out sound field playback in which there was clear voice 
to which it points more. Here, the relation between the sound source at 
the time of changing the horizontal number of sound sources into 8 and 
playback sound field is illustrated. 

[0069] Drawing 14 is the explanatory view showing the relation between 
the sound source at the time of increasing a horizontal sound source, 
and playback sound field. Here, about the mixing buses L, Cm, R, Rs, and 
Ls, when it corresponds to the 5. 1 Channel surround-sound system, it is 

the same as the above. A sound is collected by eight microphones H1-H8 
turned in the direction which divided the perimeter equally in the 
horizontal sound, and level allocation of the sound source is carried 
out using the multiplier based on the damping property between channels 
to the mixing buses L, Cm, R, Rs, and Ls. 

[0070] Thus, surround sound field and voice to which it points can be 
realized from at least three horizontal sound sources, and can be made 
the sound field playback in which there was clear voice to which takes 
for increasing the number of horizontal sound sources, and it points 
more. 

[0071] Moreover, he is trying to decide focusing on the sound of which 
direction equip a viewer' s playback device side with this surround sound 
field regeneration system, and a viewer makes surrounding sound field 
from the above-mentioned example to the voice which was collected as it 
was and supplied in the voice of an omnidirection. On the other hand, a 
sound-source side can also be equipped with this surround sound field 
regeneration system. 

[0072] for example, the voice of the surround playback output channels L, 
C, R, Ls, and Rs which carried out panning by the origination side with 
the directions from a viewer, and were generated by it when the voice of 
an omnidirection was distributed to a viewer through interactive 
broadcast (Internet) — as it is — or the signal which carried out 
compression conversion at two channels — distributing — this — a 
viewer side — winning popularity — as it is — or it can restore and 
reproduce. Also in such an interactive environment, a viewer can receive 
omnidirection sound-collecting to which the front normal position was 
carried out [ voice / to which one points according to one's hope ], and 
can hear it in surround sound field. 

[0073] Moreover, as surround sound field, although the 5. 1 Channel 
surround-sound system was shown in the example, it is applicable 

similarly about the surround audio system using virtual 5. 1 Channel or 
five channels of headphone type 5. 1 Channel surround. Moreover, the 
surround sound field regeneration system by this invention is making it 



accompanied by the image and unifying, and becomes still more effective. 
[0074] 

[Effect of the Invention] As explained above, by this invention, it was 
made the configuration so that it might have two or more level pan pot 
means to interlock mutually and to distribute horizontal voice level to 
two or more output channels among the voice which collected the sound 
from the microphone arranged to all the celestial sphere, and a 
perpendicular pan pot means to change level allocation of a vertical 
sound signal and to output to the output channel for front pin 
center, larges. A front pin center, large can be made to orientate the 
voice to which it pointed continuously [ the direction which a viewer 
wants to operate a level pan pot means and a perpendicular pan pot means, 
and to hear at the time of playback by this ], or momentarily now. 
[0075] Moreover, the voice and surround sound field to which supply 
omnidirection sound-collecting voice to a viewer as it is, and it points 
at the device terminal by the side of a viewer can be made from 
arranging a level pan pot means and a perpendicular pan pot means to the 
receiving side or transmitting side of interactive broadcast (Internet), 
and arranging a bearing input means to perform the actuation, to a 
receiving side, or the voice and surround sound field to which are 
supply sides and it points by remote operation from a viewer can be made 
from it. 

[0076] Moreover, the increment in the number of sound sources aiming at 

the sound field playback in which there was clear voice which can change 
the horizontal number of sound sources systematically, and points to it 
by the mixing bus arrangement corresponding to surround sound field is 
easy. 
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DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is drawing explaining an omnidirection voice sound- 
collecting principle. 

[Drawing 2] It is drawing having shown the principle configuration of 
the surround sound field regeneration system of this invention. 
[Drawing 3] It is the explanatory view showing the relation between 
panning of a horizontal sound source, and playback sound field. 
[Drawing 4] It is the explanatory view showing the damping property of 
horizontal panning. 

[Drawing 5] It is the explanatory view showing the relation between the 
horizontal sound source at the time of panning, and playback sound field. 
[Drawing 6] It is the explanatory view showing the damping property of 
vertical panning. 

[Drawing 7] It is the explanatory view showing the relation between 
panning of a perpendicular direction sound source, and playback sound 
field. 

[Drawing 8] It is the explanatory view showing the relation between the 
perpendicular direction sound source at the time of panning, and 
playback sound field. 

[Drawing 9] It is the block diagram showing the example of the record 

structure of a system by omnidirection sound-collecting. 

[Drawing 10] It is the block diagram showing the example of a system 

configuration of an omnidirection surround regenerative apparatus. 
[Drawing 11] It is drawing showing the example of a screen display of a 
bearing input unit. 

[Drawing 12] Water square is the explanatory view showing the relation 
between an input and a mixing bus. 

[Drawing 13] It is the explanatory view showing the relation between a 
perpendicular bearing input and a mixing bus. 

[Drawing 14] It is the explanatory view showing the relation between the 
sound source at the time of increasing a horizontal sound source, and 

playback sound field. 
[Description of Notations] 

H1-H6, T, B .... A microphone (sound signal), HP1-HP6 .. Level pan pot, 
VP ... . A perpendicular pan pot, L, Cm, R, Rs, Ls . . Mixing bus (sound 
signal), L, C, R, Ls, Rs, SW . . . . Surround playback output channel, 11, 
12, 13, 14, 15 ... . A head amplifier, 16, 17, 18 . . Analog-to-digital 
converter, 19 [ . . A decoder, 32 / . . DSP, 33 / . . A pan / level control 
table 34 / . . Audio data / PCI bridge for control, 40 / . . Bearing input 



unit ] .... A compression encoder, 20 . . Digital VTR, 30 . . An audio 
decoder board, 31 
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*3 j;t>"AGCO§IJfflI*&^^^>-:T-;Wi7)/s..y YTyyi 
1, 12. 13. 14. 15 ^TffiStcBitlf -S. i 3 1 

[0 04 9] Hrvri 1 , 12. 13. 14. 1 



/i^^m^ie, 17, i&co?^tnzmm^tix^^^. r 
-ruy ■ 'f'J^)V'm^^i 6 , 17, 1 854. mm 

2^^>'^-;PcOT-^a^-W^fi-t*3th ;c{f 16 — 2 4 

f "/ h CO V- u T)V''f=j^Mn^t,z^mi-^ . 

[00 50] T-?-n^^" • 16, 17, 1 

siomtnt. 'r'j^)vm^^ix.fz8 f-^y:^-)v<r)m^^ 

2 f-f y ^-/l-tiffiat^EQillSrfi 3 ffiffix >- :3 - y 1 9 A 
^SfLi., .rc7)8^-ry^-;l'i7)fffflx>-rj-ri 9i: L 
Tti;. tI^III bVPf-a^O^'IBflLTt r d o 1 b y E j v 

S^ff r ATRAC (Adaptive TRansform Acoustic Codi 

ng) J ^^.m-ttzthx^^. 

[00 5 1 ] JB^x^-a-^-l 9cr)\i^:hit. «^fflc7)x 
f ^:t^>-^:7j:— >!.T-i5'I.AE S/EBU 
(Audio Engineering Society /European Broadcasting 
Union) V-iX V^-TIr— ^JVt: if LXf -J 'S' )VYTK 

2 0>>zmm.^iXh. 

[0052] tJLh<7)«jS(7)^:^rfi[iRWIBiii^XxAtCi3 
UT. 9uy^yT , B. H 1— H6t:J;-:>Tit5la^ 

§ix;tWp^ft-^i4. ^fi^'ix^-y YTyTl 1 , 12. 
13. 14. 1 SfCiitlSa. i^^SiCJEtTAGCa 

[00 53] j^t. s^^y:^-;!^^^®^^}^. affix 

ya-:5^-l 9tCT2f--ry^-;KcJ±«l§ix. ^cr)2i'^ 
y^^)Va:>i^^)T)V'f-J9Mt^ii. -r"s^'^;PVTR2 0 

<7) 2 OOrt-X -I- ^ b 9 >y ^ tCfS® $tL^ . 

[ 0 0 5 4 ] HI 1 0 {ir^Srfi-^-^^y KS^fe^Bo^-x 
yYn^mm.<^mmi. ^omt-j4. n~V't>vziy\^ 

a.~'$f\,zm^^^iX^^~r^:^^-=l—fTr^-Y3 0±. 

hzmm^fi^. i^-xV^Tx^-^-'^-H ^ oa. tzh 
t\fm9^Z^Lfz'fi^^>VYTP. 2 O^Ztim^ flfzit^ 

^tzW) T)V94M.><z'S:mLtzmmK:n-t^^^~y 

3 1 SrWLTl^l.. ;Ox3-^31(±. ASjSti.:tffi 

ffi:7 ^ — -/ b o 2 ^-^^ ^-^-zi^v- u r/bf'i^' :^^;Hi-^ 
Sr. ro o 1 b y E J JEIS:? =}" -V -y hsofl^-fbi^f 
SrfflV^T. A'0<7y2i'^y^-)Vy^}TJVfJ9>V:^~'f 

^:^mn-i>z^^-Y-thmim^^Lx\^^. ^fzi-ys 

K^iHiJli. DSP (Digital Signal Processor) 3 2 
(^Atlizmm^tL^. DSP3 2J4. 40<;0 2f-W:t- 

9.>i^h-s:*aj:ti^-\'>'^-/i'L, C. R. Ls, Rs, 
S^ai:^j-?-r>'^-;i^sw{i. ^^-rV^-zt/OffiitiS^co 

L3t3&^-5T. Zcr)6':>C0^y^yYW±liitH'^y^-)l' 
L, C, R, Ls, Rs, SW{4. ^' 4 V 9 h \,z9\-^cr) 
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[0055] DSP32 ■f^yxiy^^mrn'r—y 
y^muf%^^'^yi±m.'f-i' d s p 3 2 i^zm-t. 

i: ^{f 8 b--y h~ 1 0 f.y Vnm. Sll:^r6l(i±T 1 8 

[0 0 5 6] DSP3 2i±. t.fz. ^-N-y-^/knyfi 

— :^'<7)jli;5SXn-y b-Cj)-?>PC I (Peripheral Compone 
nt Interconnect) i;<7)raT1i-^^OSS^0^m$r^T 

o ^-x ^ ^/mmm p c i t' y >y y 3 4 ^^^gM 

[00 57] ].:Ji±tfO«)^cr)^:^fi-9-9'>y ^■B^^'XT• 
A ti3 V -^T . 2 ^ ^ y^^Mzmm^titz y r;i^7^ 
;Ml-^{i. f-^i—ys 1 tTJESI:7:r-v-y box'::?- 
HAnTt)tL. lR#t7t^A'>':t^;I^T, B, HI— 
W^m^^ 2 ^-v > ;t-;px 4 ^ i; r;l^v^"i^"^;t^:t-x ^ 

[0 0 58] xrJ — K§:h.fc4o<7)>'y r/l^T-'S^^/kvf 

-X ^fi-f-ii. J^t:. D s p 3 2 [zx . ^fi^fi<r)-^ 

f4ft^Sr^f5^>'KW^feaJ:^f-^>'^-~'t. L, C, R, L 
s, Rs, S^{,znLX^^zyy^'i"{ro . ^cn>t%. 

ijiS-xts^mt^i^^-y" < ^'f~9/mn'm p c i y u 

•yy34^^rLT^>°y-y ASj $ it -g. h . ^0 

T— 7Vtx3 3 j;0DSP3 2tC-^X^>tL. DSP3 2{i: 

[ 0 0 5 9 ] EI 1 1 {i;:^fiA^J^«OilB^^<?^J2r7i^-r 
Elt'tb -!> o :^rfi A*ga 4 0 , ^-)s{k-^ "y-^y^n^ 

mW^^^—n" ^' :tx — K 3 0 tT^^°y — > 

4 0toiifflt;ii. 7K¥::^[^to^5ESr^f 3-9-7'iiiffl4 i 

[0060] :^^-Hmkjm<n^fmmA i tcji. *t 
-^j^(n^'y-^yYM^%y)^^y^-)vv., c, R, L 
s , R s <m^&M.^m5<r>m>iLij^ h^fzi.o ^ ass 

[006 1] myi'm<nrH^^mmX^fz\^ns^\iZM. ^ 
ep4 3 t0^feS^5t ^: ^'^X^J^^f t-Cd^-Y y h L 

/imiT-:fe^*ffi](:: -y i^^'tr^^^ ^EP4 3 
c?0*[^&3 6 OJ«[lllK$-li:-&>ri:ji^'T'#, ^.It'A:^J$ 



3 0(C3i^>tL§. 

[0062] mm^m'k'^'T^^ymmA 2 ji. ±t:^ 

l^tOMS«rtgtgBlSr^^^Ep4 4 >^)i3!> D . ^0^±tc± 
T*l*ac7)^{4^^^V-^4 53&iia«§:h.TV^i>„ ±T 

v'^x^i-M y^tT±T:^rrfii(cK5 -y^-LT^^i t 
T\ ±T:^l^iIc7)Sfi^rA^^^<ri:^^'■C■■#i.. -lOA:*] 
§^l/iJffi^1f#ij*TA:'3ff fSi: -Sl::t-x A ^f'n 
-^■;i-'-K3 0tciliifl^, 

[0063] J^srtC, ^—f-i F 3 0C7)D 

S P 3 2rt■C■■^f^^i?tll.7KTy^°>-.-^°^y M!i#io iVMH 

^^D^-r<^-g>^^i6lc. 7K¥*3J;t^Stl:^r6ioA;'3tc*r 
[ 0 0 6 4 ] 01 2i±7j<¥:trfi[A*i: S^i^y^'VN'xi: 

mzmwL^t\,fdmm. 5 0 l . ^^offitn;* 5 0 tora 

i^±l~. 5=^i^>'^?'^'<XL, Cm, R, Rs, Ls3&i'-e 

t\.^fm)&'th7Y.^-y^^{-mxzmm^tvc t.fz. 
-HiiLxmrnwA 0 t07i<¥*^A.ti h LT 0«j^.i> a 
5 1 ifmm'i Q>}:.n't^i},z%m^tt. ^co^miz 
a. ffitiLi*: 5 0 i: mimmti>-^m>^ 52-57 *«7Kt 

dSaStLfc-e-f :^'n:7*>'H 1 — H 6c7)rtr]§tc*fJEL 
Xmf^tiXJoKi. :itl^c^)^m^5 2 — 5 7izi±^ ^ 

ti^-ti-^-i ^rtytyui~-H6 ■^■^h^htifz^pm^ 

[006 5] i^07|<T7N°y;^°>y b c?)ia^c?54^®Ji: . lEH 
{z^m'&it^fiXv^i,AfMi:^^LX^^h . Mi 
tfc:^[^at:[lIlK^ 5 1 ^IlItT^S . t-^r;b 
mi ll3^3^fLl.^^E|I4 3SrV'^X;K-<>':5?-r'fe^ 

ys'XL, Cm, R, Ls, R s t3|llB#iC^'<.;H£:5i-SfL 

[ 0 0 6 6 ] HI 3 {iaiS:5'fuA:^j S^i^yiP'VN'xi: 
>,zmm.^flfzWMW. 6 0 L . ^^Offifii* 6 0 OMS 

>-y^'ys-xCm;d^i^§^xTt^l., 47t. -fj^xtimw. 

4 0 eoSlKfgSKA^r i; t T [tMWt^Stiifls 6 0 i: ^ 

MMis-r-i. ^wi>T- 6 1 ifimn^ixx 1 1 -I. « i o nri6>T- 6 

l«i:. mr:5--fe>'^'-ffloai^i^A'>'^-;l^cfc^M§nT 

[0067] :icr,mw^yTr^-/hcfm^cowmt. ieh 
■c\ mmt)m]}^Lfzmsj5^>^z-nim)kb i ^±t»is 
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[0068] M±c0M±, *T*l^c7)JR^^ 6^^^ 

[0069] H 1 4 i;±7k^:^[^^iJi^ti^L/-c±i'^(7)^ 
Mtn^'Mmtcomi^^i^^'tMmmxh^. ^^x\ s 

^i^y^Vs;;;?.L, Cm, R, Rs, LstCOl->T{±. 

Lf^:^r[6ilcifiitt'?>ti.^c8oco-?-f ^'n:7^yH i—hs 

tiOiRWSil, S=5ri^y^VS-XL, Cm, R, Rs, 

L s izMLx^-r y^-fi'm<7)m^ma htiz Ltzum. 

[0 0 7 0] ^Oi^tC. -t?-^'>yKW:*^:Jg|^fI-r-S.^ 

;6i^iTtgT* D . y^'fi^mmwM^m'^^izmh.x X Kim 

[007 1] ±IBoM-C-{i, i<7)-r9'>^b'#« 

^pi^cr)itm^^riXim^h.tz^^^zMLxnm 
^^t'cDijt^io^i^'C-tLxmmco^^ii^^m-^^ 

mbhXoiztX^'^^. ^tit,zML. iico-^^^y]^^ 
[0 0 7 2] fzhtif-^y^-'^^r-^ymm {Ay 9 
nWk-b^t^(nWi^\,zi.'^xwmstQnv-v7'\.. 

L, C, R, Ls, Rsi7)#pS^'?-Oii, fel>l,'>{i2 
T-§^. Zcr>X'3ti:Ay9~'79'T ^-fWrniZav^X 

[00 7 3] tfc. -y-^-^i^^-^tii; tTii. 5. 1^ 
>'^-/I^-f 5 >- K CO 5 ^-^^ >- ^t-^l-^ ffio 7t-+?-^ b'^ 

[00 74] 



[007 5] 4?^^, 7\(.^>^y^.y v^finkx/mw^y 
4^ b Sr -f > - 9 ^ T- i-iy^-^^-/ 

[0 07 6] tfz, ^'y'^yv^m^znm^^^^i^y 
s-r-s.^i:A-'T§. ^^\^-t^=^-p^mm^zLfz^mm^ 

[ H 2 ] 3|s:^BHotf 9 ^ y AiOMUffi 

[03] 7^^:H\^wM(DJ-^y-y^tm^=u%h(Dm\^ 
[04] 7J<T:^rl^ilw^°>->^5^o^«#1£^^-f^^0fllll 
[05] ^N°>'^>mo7kT:tri^Wiii;S^^^i:coM 
[06] S[i::^ritiWN°y^>'i7'<5OM«#ttSr^-n^0fl0 

[07] M^t:^l^^]#^gOy^°>-->'^i;g^$^i;^^)Pa^^ 

[08] ^'^y—y^ncr)mm.-)i^^U}iM^'U^hcr)m 

i^ii^^-tmmmxhh . 

[09] ^:^{4JKWtJ;^iB«i>'>!.xAc7)«ji£^j^^-r 
7'n yi^mxh^. 

[010] ^^r{4-9-9'>>'KS*S«o£^;^.7^A«fig^J 

[011] ■^iij<nmm.<mmm^m^^-tmxh^. 
-tmmmx'hh. 
-riSBJ30T'*)^, 

[014] 7i^^ii\pm^m'¥Lfzm^<mmbn±^ 
^b^mi^i ^^mmx'h i> . 

H1-H6, T, B -^A^xjy^y (^^fi-t) , 



(8) 002-345097 (P2002- 97 



HP 1 —HP 6 7KTy\°y*r.y VP mw^y 

L, Cm, R, Rs, Ls S ^i>>^^'"VS^X 

(^^ff-^) ^ L, C, R. Ls, Rs, SW 

^yv^W^mti^^ry^-j]^. 11, 12. 13. 14. 
15 ^vvryy\ i6. it, is ri-u:^ 



■ f'J^J^^mm. 1 9 J±aixyn^^\ 2 0 

3 1 3 2 DSP. 3 3 ^^yX\y 

^mmi^-r^]^. 34 ^ :ty'-^xmmm 




[112] 



L Om R Rs Ls 





A=1(0dB) 
A=-0.7O8C-3dB) 



[H4] 




[05] 




[me] 



[HI 3] 



A=l(OdB) 
A=-0.708(-3dB) 
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